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This booklet contains the printed material for use with Audio-tape 3 for the 
audio-tape sections of Networks 3 and Audio-tape 4 for the audio-tape 
sections of Graphs 4. 


You will need to play the tape at the same time as you study the frames on 
the following pages. 


et 


Place the cassette player within easy reach. There are points on the tape 
where we have indicated that we want you to stop the tape and do some 
work for yourself, but you will probably find it necessary to stop the tape 
more often than this. Indeed, you should get into the habit of frequently 
stopping the tape and giving yourself time to think. 


Make sure that you have paper and pencil handy before starting each tape 
sequence. 


BLOCK 3 


Notes for Networks 3 


There are three sequences on the tape for this unit. The heading numbers 
below refer to the corresponding sections in Networks 3. 


In each tape sequence we demonstrate the use of an algorithm to solve an 
example. In the first two tape sequences we then ask you to use the 
algorithm to solve a problem. There is a problem on the third algorithm in 
the text of the unit. Additional problems requiring the use of these three 
algorithms are given in the Computer Activities Booklet. 


Each algorithm involves finding matchings in bipartite graphs, and is based 
on the idea of an alternating path, introduced in Section 2. As a reminder, 
this definition is given below. 


| Definition 


Let G be a bipartite graph in which the set of vertices is divided into two 
disjoint subsets X and Y. An alternating path with respect to a matching 
M in G is a path which satisfies the conditions: 


_ (a) _ the path joins a vertex x in X to a vertex y in Y; 

| (b) the initial and final vertices x and y are not incident with an edge 

| in M; 

(c) alternate edges of the path are in M, and the other edges are not 

in M. 

2.2 Maximum matching algorithm 

3.1 Hungarian algorithm for the assignment problem 

4.1 Hungarian algorithm for the transportation problem 


A formal statement of each algorithm is given in the unit. You should have 
the unit open at the appropriate page whilst listening to each tape 
sequence. 


Page 14 has been left blank to enable other frames to face each other. 
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BLOCK 4 


Notes for Graphs 4 


There are two sequences on the tape, both associated with Section 5. The 
numbers 5.3 and 5.4 below refer to the corresponding sections in Graphs 4. 


In each sequence we describe an algorithm for solving a particular problem 
using a branch and bound method. The problems are: 


5.3. the knapsack problem; 
5.4 the travelling salesman problem. 


Each algorithm involves a search for an optimum solution based on the 
following ideas: 


¢ a branching tree for structuring the search; 


* successive improvement of a lower bound for a number to be 
determined. 


In the case of the knapsack problem, the number to be determined is the 
total value of items packed. 


In the case of the travelling salesman problem, the number to be determined 
is the total length of the route. 


1 WORKED PROBLEM 
Find a maximum matching in the following bipartite graph. 


x; yi 


Ye ~V~ USE 


¥3 / @ labelling procedure | 
\ © matching improvement procedure 


2 SOLUTION TO WORKED PROBLEM 
PART A: LABEL VERTICES 


STEP 1 Ser x Ser S STE Zz 
label xs label ys label xs label ys 


Re 
breakthrough } 
at Y3 5 


| | / “alternatively, 
initial matching M e | \ could label 


. ¥awith x, 


PART B: IMPROVE MATCHING 
STEP 4: FIND ALTERNATING PATH 


OY (xs) 


an alternating path is & alternatively: 
YS X2Y2 XB ? ¥3X4 V4 XB 


2 SOLUTION CONTINUED 
STEP 5: CONSTRUCT REVISED MATCHING 


x yi x yi 
X2 y2 ae X2 Y2 
XS ¥ %S ¥ alternatively: 
= \ XY %2Y20 V4, Xe Yo ) 
X4 4 = Mh ¥4 2 a 
original matching revised matching 
XY 2Y2 4 Y4 MY 4 4, 2 Y3» V2 


Since the revised matching has 4 edges, it is a maximum matching. 


3 SUMMARY OF THE ALGORITHM 
START with any matching. 


Part A: labelling procedure -—— 


Label the vertices to identify an alternating path. ( Freak Tarctial oeeerar Witt 2 

If breakthrough is achieved, go to Part B. nn, Scien with 
: : L any edge in the current 

If breakthrough is not achieved, STOP: = eg q is labelled 

the current matching is a maximum matching. 2° | 


Part B: matching improvement procedure 
Find an alternating path by tracing back through the labels. 


Form a new matching from: 
* the edges in the current matching NOT IN the alternating path, 
* the edges in the alternating path NOT IN the current matching. 


-Return to Part A. 


4 PROBLEM 


Find an improved matching in 
the following bipartite graph. 


5 SOLUTION ~ 

PART A: LABEL VERTICES = 

- STEP 2 STEPS 
label xs 


STer | | 
label ys 
(x) x 


label xs 
(x) x 
: Y% (x) | 
i (vi) X2 ; 
vK__ breakthrough 
at y2 | 


y2 = 3 
| (y3) x3 
ys (Xa) , wi eee © 
(x) x4 /- alternatively, 
could label 
a sie % : 


PART B: IMPROVE MATCHING 
_ STEP 4: FIND ALTERNATING PATH 


an alternating pathis alternatively: 
Y2x2Mx } © YaXB Ya Xa 
Sia _A Leas, 


(x) x 


STEP 5: CONSTRUCT REVISED MATCHING 


Fn a aa le * 
ie, 


pond 


2 


initial matching revised matching a 
X33, % Vin Xo Yo ( alternatively: 
 X2 Vv X3 Yes X4.¥3 


X2 Vi» XB YS 


Since the revised matching has 3 edges and there are 
only 3 vertices in Y, it is a maximum matching. 


The Hungarian algorithm for the assignment problem 


| USE 
¢ labelling procedure 

e matching improvement procedure 
¢ modification of partial graph procedure 


WORKED PROBLEM Ls ge BA 
Find the optimum assignment in the following case. | 
3 jobs | 
q = ae a 


: | 4 & @ 1 A | 
_ —s applicants cost da 


| ee See > eee ae eee AL 


10 6 2 


cost matrix 


2 SOLUTION TO WORKED PROBLEM 


STEP O: CONSTRUCT INITIAL PARTIAL GRAPH 
4 weights 
3 se & % 


weights > O O O 3 | 

Yo ¥4 
: ; ~ om (5 Irae 
. 9 % O Ys a by aracel ) 
7 rn ee O Y4 | 2 


2 SOLUTION CONTINUED 
PART A: LABEL VERTICES 


first revised cost matrix 


FART C: MODIFY PARTIAL GRAPH 
STEP 6: FIND 6 
unlabelled ys 


O x4 


first revised cost matrix 


STEP 7: REVISE COST MATRIX AND PARTIAL GRAPH 


STEPS 1,4 STEP? 


(x) MY (%) 


yi 


labelled partial graph 


unlabelled ys 


no 
breakthrough 


te. Se es 


2 SOLUTION CONTINUED 
FART A: LABEL VERTICES 


tee SIEF 2 OEP eo Sibne 


(*) x Mv (x) (x) x Mi (x1) 
X2 y2 | (Yi) Xe ae pn ee 
| Bae breakthrough 
Xz | Ys X3 ) ¥3 | al Y4 
X4 4 X4 y4 (Xz) 
second partial graph labelled partial graph 


FART B: IMPROVE MATCHING 
STEP 4: an alternating path is y.x> yx). 


STEP 5: revised matching is: 


new matching 
XB Yo, %4 YS» X Yi, X2 Ya 


or 


oe a gee eee eS, 


oi? © 6 9 6x10 45°02 


original cost matrix final revised cost matrix 


optimum assignment: xy, Xy4.X3Ye, Xa.ya 7 = | 
total cost:6 + 11+5+6=28=10+84+5+6-440+0+23 


TRACK 419 o 


3 SUMMARY OF THE ALGORITHM 


START with no matching. ‘ 
Assign weights to the vertices and construct the first partial graph. 
Part A: labelling procedure 


_ Label the vertices to identify an alternating path. 
_ Ifnone of the vertices on one side of the graph can be labelled, STOP: 
the current assignment is an optimum assignment. 


FeO 
_L ~ SHORT CUT 
If breakthrough is achieved, go to Part B. first time only — find 
If breakthrough is not achieved, go to Part C. } matching by inspection 


Part B: matching improvement procedure 


Find an alternating path by tracing back through the labels. 
Form a new matching. 
Return to Part A. 


Part C: modification of the partial graph procedure 
Construct a revised cost matrix as follows. 


On the existing cost matrix: 

draw a horizontal line through each labelled vertex in X; 

draw a vertical line through each labelled vertex in Y; 

e find the smallest entry 6 with ONLY a horizontal line through it; 

e decrease all entries with ONLY a horizontal line through them by 6; 
increase the weight on the corresponding vertices in X by 8; 

* increase all entries with ONLY a vertical line through them by 0; 
decrease the weight on the corresponding vertices in Y by 6. 


Construct a revised partial graph. 
(Remove any edge that now has a non-zero cost.) 


Return to Part A. 


4 PROBLEM 


Find the optimum assignment 


in the following case. " 


14 


cost matrix 


10 


fi 


nH. 3A 
4 6 


“A 8 
mig 6 & 
X4 12 & 14 5 


cost matrix 


rst revised cost matrix 


— 


bipartite graph Kaa 


first partial graph 


matching 


11 


Sters 5,2 


(y2) x 


X2 


: no | 
(x) xz . breakthrough 


X4 


first revised cost matrix labelled partial graph 


PART C: MODIFY PARTIAL GRAPH 
STEP 6: FIND & 


unlabelled ys 


5 SOLUTION CONTINUED 
PART A: LABEL VERTICES 


STEP 1 STEP 2 | breakthrough 


x; YW () <n _K 
X2 ¥2 

(x) xg ¥3 
4 OO Ys 


labelled partial graph 


FART B: IMPROVE MATCHING 
STEP 4: an alternating path is yixz 


STEP 5: revised matching is: 


x) OL Mi 
as we new matching 

: | x y3 5X4 V4, XY 
Xa Ys 3 1Y2> 2YB » X4 Yas YI 
en A 


FART A: LABEL VERTICES STOP 


} impossible ) 


lee ae 


o x O 

ae Oe © See eee 

ieee et ee Fee 

Oo mi 2 t= 
original cost matrix | final revised cost matrix 


\ 
optimum assignment: xi yo, x2 Ys. X3 Yn X4Ya 
total cost:4+6+94+68=29=54+84+7+84+2-140+0 


e labelling procedure } 
e Tlow-augmenting procedure 

es St modification of partial graph procedure 
ie | 


% 


OLUTION TO WORKED PROBLEM 
TEP O: CONSTRUCT INITIAL PARTIAL GRAPH 


weights 
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2 SOLUTION CONTINUED 
PART A: LABEL VERTICES 


“SIEPS +3 


_ First iteration 


breakthrough at b, re 


Second iteration 


4 ob; (0) (Ai) 
(*) (2) A oe 
‘(#*) On : | 


be (Az) 


breakthrough at bo 


Third iteration 
; 4 OD (A;) 
(*) (2) A; ee: aoe 
bz (O) (Az) 
(*) 3) Az ; | 
bs (5) (Az) 


breakthrough at bz 


Fourth iteration 


) 
reakthrough 


: sai? 
eet ee al tal 


Se, 


bz (5) (Az) 


4 

? 
(b 
\ 


sewn 


_ PART B: AUGMENT FLOW 
~ STEPS 4,5 


Ga, pla ae 


| b2 (6) 
| Az 
bs (6) 
° flow-augmenting path is A,P, 
¢ min (6, 4) =4 
e send flow of 4 down AP 


° flow-augmenting path is Asbo 
e min (S, 6) -©6 
e send flow of © down Asbz 


Cire 
OF 6 bp (0) 
20m 5 i® 


¢ flow-augmenting path is Azbs 
° min (5, 5) = 23 
e send flow of 5 down Asbs 


2 SOLUTION CONTINUED 
PART C: MODIFY PARTIAL GRAPH 
STEP G: FIND § eee 


ie beled < 


first revised cost matrix 


STEP 7: REVISE COST MATRIX AND PARTIAL GRAPH 


OBS 
©) ©) @) 
B, De ba 


second revised cost matrix 


FART A: LABEL VERTICES 


b, (0) (A) 
bz \O) (A;) 
bs (2) (Az) 


breakthrough at bz 


maximum bochnnd 
flow along Agb2is 6 


final flowis 4 along A\b, withcost (4x3) 
2 along A,b2 + (2x5) 
4 along Asbe + (4 x 4) 


second partial graph 


PART B: AUGMENT FLOW 


obs (0) 
flow-augmenting path is bs Asb2A; 
min (6, 2, 2) = 2 
increase flow by 2 on Ajbo, Aobs 
decrease flow by 2 on Ab 


5 along Aob= + (5X 3) =53 
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3 SUMMARY OF THE ALGORITHM 


START with no flow. 
Construct the initial partial graph. 
Part A: labelling procedure 


Label the vertices to identify a flow-augmenting path. 
If no labelling is possible, STOP: 
the current solution is a minimum-cost solution. 


em 
i a tg _ 
yer i ee ’ CE es — 


x — 
Fatt leita occurs when a) 
If breakthrough is achieved, go to Part B. \ demand vertex is labelled whose *) 
If breakthrough is not achieved, go to Part C. \ demand is not satistied ie 
on ; 
ea. a tf" 


aes Mn, 


Part B: flow-augmenting procedure 


Find a flow-augmenting path by tracing back through the labels. 
Augment the flow. 
Return to Part A. 


Part C: modification of the partial graph procedure 
Construct a new revised cost matrix as follows. 


On the existing cost matrix: 

draw a horizontal line through each labelled supply vertex; 

draw a vertical line through each labelled demand vertex. 

¢ find the smallest entry 6 with only a horizontal line through it; 

e decrease all entries with only a horizontal line through them by 6: 
increase the weight on the corresponding supply vertices by 6; 

¢ increase all entries with only a vertical line through them by 6; 
decrease the weight on the corresponding demand vertices by 5. 


Construct a revised partial graph. 
(Remove any edge that now has a non-zero cost.) 


Return to Part A. 
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Construct initial 
partial graph 


no labelling 
possible 
Part A, Step 1 
Label supply vertices 
whose supplies are 
unallocated 


labelling possible 


Part A, Steps 2, 3 
Label supply and 
demand vertices 


breakthrough breakthrough 


achieved not achieved 
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WORKED PROBLEM 


. & Consider five items with the following weights and values. 


3: 


USE 
branching tree 
lower bounds 


A solution vector is a sequence of the form ( Xp Xo» Xs X4s Xa); 


x. =1) if item iis packed; 


where if item iis not packed. 


i 


A feasible solution is one which satisfies the weight constraint. 


(1, 1, O, O, 1) corresponds to items A, B and E packed, E feasible 
with total weight w=4+2+4+1=7(<9) V __ Solution 


(O, 1, 1, O, 1) corresponds to items B, C and E packed, r infeasible 
with total weight w= 2+7+1=10 (> 9) » solution 


3p BRANCHING IDEA 


For example: 


(0, 1, 1, O, O) / these have one 
_ more item than 

ao, 1,0) \. the previous 

(0, 1, O, O, 1) | solution vector 


add a to the 
right of this 1 


4 DECIDING HOW T0 BRANCH 


For example: 


(1, 1 és i, O) = < “infeasible | 
| > infeasible — 
CP 1 0,0) xe ee 


(1, O, O, 1, 0) oie 
ee ergs maximum ) 
WO.8,0,1) wed “weight 


b _ 
> oy 
( no furth rther | 


cee ee 
branching ) 


\ possible _/ 
ae ee 


(1, O, O, O, O) 


Next step: branch out from (1, 1, O, O, O). 


5 OUTLINE OF ALGORITHM 


START with zero vector (0, 0, ..., 0); antes with value0. zero vector is 
STORE (0, 0, ..., 0) and value 0. =a 


Branch from first solution from which branching is possible. 
Calculate total weight of each new solution. 


Calculate total value of each new feasible solution. 
If there is a new feasible solution with value greater than the 
value stored, store the new solution vector and its value ~~~ 
_ instead. (no further 
Mark vertex with C if it corresponds to: / branching 
possible from 


ae 


CO a vector which equals or exceeds weight restriction; 
O] a vector which ends in 1. 


the GENERAL STEP until no more branching is possible. 


Stored solution vector and value is optimum solution. 


21 


SPINNER 


ey we 
Meet 
Ss 


; P a. 
‘. a ‘ a 


Pe 


oy Pr asi a io 


2 
A errr, F 


total weight w 


not more than 9 


First branching: from zero solution vector O = (0, O, O, O, O) withv = O: 


(1, O, O, O, O) 
(O, 1, O, O, O) 
(O, O, 1, O, O) 
(O, O, O, 1, O) 
{2.0,0,0,9 


Second branching: from (1, O, U.2,0> 


(0, 1, 0, O, O) 
(O, O, 1, O, O) 
(0, O, O, 1, 0) 


(1, 1, O, O, O) 


(1, O, 1, O, O) 
I(1, O, O, 1, O) 
(1, O, O, O, 1) 


(1, 0, O, O, 0) ————e(1, 1, O, O, O) 


STORE (1,1, 0,0, 0), v=" 


(1,1,1,0,0) w=13 
(1.40.40) wet 
440.0 w=7 


STORE (1,1, 0, O,1),v =12 


Fourth branching: from (0, 1, O, O, O): 


(0, 1, 1,0, O 
(O, 1, O, O, 0) - (0, 1, 0,1, O 
260, 0,1, 0, O) (0, 1, O, O, 1 


_ G°(0, O, 0,1, 0) 


STORE (0, 1,1, 0, O), v=17 


Fifth branching: from (O, 1, O, 1, O): 


(0.1, 00,0) siete W 
Oe Y=4 (0, 0, 1,0, 0) 
) -68(0, 0, 0,1, 0) 


Sixth branching: from (0, O, 1, O, O): 


(O, O, 1,1, O 
(O, O, 1, O, O) 
Oe (O, O, 1, O, 1 


) 2a (0, O, 0,1, 0) 


Seventh branching: from (O, O, O, 1, O): 


Oe-——— (0, 0, 0, 1, 0) ———{#](0, 0, O, 1,1 


No further branching is possible: STOF. 


Solution vector is (0, 1, 1, O, O): items B and C, with value 17. 


™ 


the travelling salesman problem 


WORKED PROBLEM 
Find a 5-cycle throughA, B, C, D, E with minimum total ength: 


USE 
e lower bounds 
¢ branching tree 


2 GETTING LOWER BOUND FROM TABLE 


\ 
° one entry from each row 
\_@ one entry from each column 


lower bound i61+2414141= 


5 DECIDING HOW TO BRANCH 


. try to get-maximum 
increase in lower bound 


exclude AC ? 


lower bound increases by 1 + O = 1 


Label each zero with possible increase in lower bound. 


Select an edge whose exclusion gives maximum increase in lower bound. 


maximum increase in 
lower bound arises 
from excluding AC 


£ selectAC | 


lower bound 7 | 
include AC exclude AC (cross out AC 


(S0 exclude CA) 


{ delete ena : 
>and column C, B 


(Cross out CA te -s 


5 OUTLINE OF ALGORITHM 


START with a given n xn table of distances, corresponding to a 
complete weighted graph with n vertices. 
Carry out the initial row and column reduction, and calculate 
the initial lower bound. 


¢ Consider all the edges with zero weight, and choose an 
allowable edge e whose exclusion leads to the greatest 
increase in lower bound; if there are several such edges, 
choose the first. 
Consider the consequences of including e and excluding e.\_ 
Use row and column reduction to determine these 
consequences, in terms of increases in the lower bound. 
Choose the option which gives the smaller lower bound; if 
the lower bounds are equal, include the edge e. 
STORE the current list of included edges, and the current 
lower bound. | 


Continue from the current position unless the chosen option 
has a lower bound greater than a previously eliminated 
option, in which case backtrack to the earlier position. 


the GENERAL STEP until a cycle with n edges has been created. 


Stored list of edges is optimum solution. 
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6 SOLUTION TO WORKED PROBLEM 


Consider edges with zero weight: 


reduce rowC by 2 
reduce column E by 1 


O 


1 
E 
O 
z 
s) 


include AC 
10 


select AC © 


TRAUK 13 = 


7 SECOND BRANCHING 


Consider edges with zero weight: 


select BC 


(lower bound increases by 2, 
the maximum possible) 


include BC exclude BC 


(so exclude CB) 


lower bound remains 9 © 


new lower bound is 9 + 2 = 11 


include AC 
10 


include BC | 
9 


(—nence > 
(nace w) 
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& THIRD BRANCHING 


Consider edges with zero weight: 


include AD 
(so exclude DA) 


reduce column E by 4 
O O 4 


new lower bound i 94+ 4 = 15 


include AC 


“Ronnnngnioniinsiniiiny 


“a 2 


‘ 
: 
Z 


select AD 


(lower bound increases by 4, 
the maximum possible) 


O 


new lower bound ig 9+4 = 13 


exclude AC 


include BC 


9 


need to a include AD (7) 


1S 


exclude AD 
15 


~) 


exclude BC 
11 


lower bound increases 
the maximum possible) 


include BD 
(So exclude DB) 


reduce column E by 2 reduce column D by 2 
ua foe «te 8 


include AC \ exclude AC 
a C) 


include BD (Aexclude BD (Yin BC exclude BC 


2. 12 9e-, 7 a 


inGlede AD exclude AD “Weed to 
13 | io. ——— 
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10 FIFTH BRANCHING 


Consider edges with zero weight: 


- om 


select CA 


lower bound increases by 2, 
the maximum possible) 


new lower bound is 11+ 1= 12 


include AC 


Chae BD exclud . exclude BC 
12 | 11 


include CA o exclude CA 
Se 


11 SIXTH BRANCHING 


Consider edges with zero weight: 


select AE 


(lower bound increases by |, 
the maximum possible) 


include AE | exclude AE 
(S0 exclude EC to 
avoid 3-cycleAECA) 


lower bound remains 12 


reduce column E by | 


~~ fo 


12 FINAL BRANCHINGS 


Consider edges with zero weight: 


include BD 
(so exclude DB) 


lower bound remains 12 


Include DC and EB 
lower bound remains 12 


required 5-cycle has edges 
CA, AG, £6, BO CC 
and weight 12 


9 


(2) include AC 
10 


eo Gyexclude BD (4) 


ee eS mt} 
( get same cycle ) 
\ (in | 
\ 


opposite direction) : 
| from here ae, 


include AD 
in 


y 


include BD 
12 


include DC, 


ED 12 


select BD 


(lower bound increases by 3, 
the maximum possible) 


exclude BD 


not possible! 
(no route out of B) 


exclude BC 
11 


exclude CA 
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Printed in the United Kingdom. 


